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Abstract 

Classical approaches for asymptotic convergence to the global average in a distributed fashion 
typically assume timely and reliable exchange of information between neighboring components of a 
given multi-component system. These assumptions are not necessarily valid in practical settings due 
to varying delays that might affect transmissions at different times, as well as possible changes in 
the underlying interconnection topology (e.g., due to component mobility). In this work, we propose 
protocols to overcome these limitations. We first consider a fixed interconnection topology (captured 
by a - possibly directed - graph) and propose a discrete-time protocol that can reach asymptotic 
average consensus in a distributed fashion, despite the presence of arbitrary (but bounded) delays in the 
communication links. The protocol requires that each component has knowledge of the number of its 
outgoing links (i.e., the number of components to which it sends information). We subsequently extend 
the protocol to also handle changes in the underlying interconnection topology and describe a variety of 
rather loose conditions under which the modified protocol allows the components to reach asymptotic 
average consensus. The proposed algorithms are illustrated via examples. 
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I. INTRODUCTION 

Centralized approaches in multi-component systems require the collection of measurements 
or other information to a central location (at possibly high communication and computational 
cost), the computation of quantities of interest at this central location, and then the dissemination 
of these quantities to (a subset of) the components. This approach is often inefficient or even 
unrealizable (e.g., in ad-hoc networks that do not posses explicit routing mechanisms). Coopera- 
tive distributed control/coordination algorithms and protocols have therefore received tremendous 
attention, especially during the last decade. Several diverse research communities (e.g., biology, 
physics, control, communication and computer science) have made several contributions that have 
resulted in many recent advances in so called consensus-based approaches (see, for example, 
(2j) and in distributed computation of functions of geographically dispersed data, also known as 
in-network computation (see, for example, [3] and references therein). 

A distributed system or network consists of a set of components (nodes) that can share 
information via connection links (edges), forming a directed interconnection topology (directed 
graph). In general, the objective of a consensus problem is to have all agents agree upon a certain 
(a priori unknown) quantity of interest that is typically a function of some values that the nodes 
initially posses. When the agents (asymptotically) reach an agreement to the same value, we say 
that the distributed system (asymptotically) reaches consensus. Such problems include network 
coordination problems involving self-organization, formation of patterns, parallel processing, 
and distributed optimization. The problem of convergence of discrete-time consensus algorithms 
was initially targeted by Tsitsikis et al. [ffj and subsequently by many other researchers (see, 
for example, p|-p3|). Convergence of consensus algorithms can usually be established under 
relatively weak requirements. Typical applications involve motion of mobile agents (e.g., coor- 
dination of unmanned air vehicles, autonomous underwater vehicles, or satellites) and averaging 
of measurements in wireless sensor networks. Common challenges include the handling of node 
failures (e.g., due to the draining of batteries in wireless sensor networks), transmission delays 
on the transfer of data between agents, packet losses in wireless communication networks, and 
inaccurate sensor measurements. As a result, it is imperative to address agreement problems that 



consider networks of dynamical agents, possibly with directed information flow, under delays 
and/or changing topologies. It is worth pointing out that consensus protocols have been relatively 
successful in addressing disturbances due to delays (e.g., [[8), 0, p"4fl), packet drops (e.g., p"5| , 
|T6|), and changing interconnections (e.g., (6j, |7J), or a combination of them (e.g., [|5j, fn\). 
What is different in this paper is that we devise a protocol that is able to overcome such limitations 
while reaching consensus to the exact average of the values that the nodes initially posses. More 
specifically, by utilizing the suggested protocol, the value at each agent reaches the exact average 
of the initial values of all the agents, even in the presence of (bounded) transmission delays and 
changes in the interconnection topology. 

One of the most well known consensus problems is the so-called average consensus problem 



in which agents aim to reach the average of their initial values (see, for example, [ |T8fl , JT9)). It 
has been shown in [|5J that, under a fixed interconnection topology, average consensus is achieved 
by performing a linear iteration in a distributed fashion if the interconnection topology is both 



strongly connected and balanced, while convex optimization [20|-[22| require update matrices 
that are doubly stochastic. Even though various approaches have been proposed for forming 



a balanced matrix (e.g., p3| , p4| ) and a primitive doubly stochastic matrix (e.g., [ fTlj l, p5]|), 
which can subsequently be used for reaching average consensus, most existing schemes are not 
applicable in directed graphs and/or fail in the presence of delays and changing interconnection 
topology. In particular, among the limited existing algorithms that guarantee convergence to 



the exact average in a directed graph (e.g., p6|-p8||), few of them have addressed delays and 
topology changes, and it is unclear how/if these techniques can be modified to overcome such 
disturbances. 

The methodology developed in this paper is based on an algorithm suggested in p6| that 
solves the average consensus problem in a static directed graph using a linear iteration strategy 
in which each node vj distributively sets the weights on its self-link and outgoing-links to be 
(where X?+ is the out-degree of node Vj); the collective set of weights results in a column 
stochastic weight matrix P that is not necessarily row stochastic. Using the weights in matrix P, 
average consensus is reached in [26] via ratio consensus, i.e., two iterations (with appropriately 



chosen initial conditions) that run simultaneously so that the average can be obtained at each node 
by taking the ratio of the two values (maintained at each node for each of the two iterations). An 



equivalent approach for gossiping algorithms was also proposed in [29 1, which is a generalization 



of the gossiping algorithm proposed in [30|. The idea of ratio consensus can be traced back much 



earlier pT| (see the discussion on weak convergence at the end of Chapter 3 in pl|). 

In this paper, we investigate the problem of discrete-time average consensus in a multi- 
component system under a directed interconnection topology in the presence of bounded delays 
in the communication links and changing interconnections (due to communication links being 
added or removed, as in a mobile network setting). First, we consider a fixed topology and we 
devise a protocol, based on ratio consensus, where each node updates its information state by 
combining the available (possibly delayed) information received by its neighbors using constant 
positive weights. We establish that, unlike other consensus approaches, this robustified version 
of ratio consensus, henceforth called robustified ratio consensus, converges to the exact average 
of the nodes initial values, despite the presence of arbitrary but bounded time-delays. Then, 
we allow the communication links to change (at the same time we also allow communication 
delays in the network) and enhance the proposed robustified ratio consensus algorithm so that the 
algorithm is immune to arbitrary changing interconnection topology and delays. We show that it 
is possible to asymptotically reach consensus to the exact average in a distributed fashion for a 
network with changing communication links and delays, as long as the delays are bounded and 
the unions of graphs over consecutive time intervals form strongly connected graphs infinitely 
often. 

The remainder of the paper is organised as follows. In Section [TTJ. the notation used throughout 
the paper is provided, along with some background on graph theory that is needed for our 
subsequent development. This section also outlines the algorithm proposed in this paper. In 
Section [Till we describe our model for communication link delays and our model for changing 



interconnection topology in the multi-agent system. In Section IV we consider a fixed topology 
and study the behavior of our algorithm in the presence of delays. In Section [V] we consider a 
fixed set of nodes and allow changes in the communication links among them in order to study 



the behavior of our algorithm in the presence of both interconnection topology changes and 
delays. Finally, Section VI summarizes the results of the paper and draws directions for future 
research. 



II. NOTATION AND PRELIMINARIES 

A. Notation 

The sets of real, integer and natural numbers are denoted by R, Z and IN, respectively; their 
nonnegative counterparts are denoted by the subscript + (e.g. R+). Vectors are denoted by small 
letters whereas matrices are denoted by capital letters. The transpose of matrix A is denoted by 
A T . By 1 we denote the all-ones vector and by / we denote the identity matrix (of appropriate 
dimensions). A matrix whose elements are nonnegative, called nonnegative matrix, is denoted 
by A > and a matrix whose elements are positive, called positive matrix, is denoted by A > 0. 

In multi-component systems with fixed communication links (edges), the exchange of infor- 
mation between components (nodes) can be conveniently captured by a directed graph Q(V,£) 
of order n (n > 2), where V = {v i, v 2, ■ ■ ■ , v n } is the set of nodes and £ C V x V is the set of 
edges. A directed edge from node Vi to node Vj is denoted by = (vj,Vi) G £ and represents 
a communication link that allows node Vj to receive information from node i>j. A graph is said 
to be undirected if and only if Sji G £ implies G £. In this paper, links are not required to 
be bidirectional, i.e. we deal with directed graphs; for this reason, we use the terms "graph" and 
"diagraph" interchangeably. Note that by convention and for notational purposes, we assume 
that the given graph does not include any self-loops (i.e., ejj £ for all Vj G V) although each 
node vj obviously has a link (access) to its own information. A directed graph is called strongly 
connected if there exists a path from each vertex Vi in the graph to each vertex Vj (Vj ^ Vj). In 
other words, for any Vj, Vi G V, Vj 7^ one can find a sequence of nodes Vi = v^, vi 2 , Vi s , . . ., 
vi t = Vj such that link {vi k+1 ,Vi k ) G £ for all k = 1, 2, . . . ,t — 1. 

All nodes that can transmit information to node Vj directly are said to be in-neighbors of node 
Vj and belong to the set A/^ r = {vi E V \ £ji G £}. The cardinality of J\f~, is called the in-degree 
of Vj and is denoted by Vj = The nodes that receive information from node Vj belong 



to the set of out-neighbors of node Vj, denoted by J\fj~ = {yi G V | £y G £}. The cardinality of 
Afj~, is called the out-degree of Vj and is denoted by Z>+ = |A^ + |. 

In the type of algorithms we will consider, we will associate a positive weight pji for each 
edge Eji G £ U {(fj,i>j) | Vj G V}. The nonnegative matrix P = [p^] G R+ Xn (with as the 
entry at its jth row, zth column position) is a weighted adjacency matrix (also referred to as 
weight matrix) that has zero entries at locations that do not correspond to directed edges (or 
self-edges) in the graph. In other words, apart from the main diagonal, the zero-nonzero structure 
of the adjacency matrix P matches exactly the given set of links in the graph. 

In a synchronous setting, each node Vj updates and sends its information to its neighbors at 

discrete times to, t\, fa, We index nodes' information states and any other information at time 

tk by k. We use Xj[k) G R to denote the information state of node j at time t^. We first consider 
a static network where the graph connectivity remains largely invariant (as it is usually the case 



for distributed resources in applications, such as the power grid [26|, |32|). At each time step 
k, each node Vj updates its information state to Xj [k + 1] as a weighted linear combination of 
its own value Xj[k) and the available information received by its neighbors {xi[k] \ Vi G Nf}- 
The positive constant pji captures the weight of the information inflow from agent Vi to agent 
Vj. In this work, since we deal with directed graphs, we assume that each node Vj chooses its 
self- weight pjj and the weights pij on its out-going links v\ G . Hence, in its general form, 
each node updates its information state Xj[k + 1], k = 0, 1,2, . . ., according to the following 
relation: 

x j [k + l]=p jj x j [k]+ PjiXi[k] = PjjXjlk] + ^ x^[k], (1) 

where Xj^i[k] = pjiXi[k], Xj,[k) G R, is the value sent to node Vj by node t>j at time step k. 
[Note that, since node Vi chooses the weight pji, it is more convenient to sent Xj^i[k] instead of 
separately sending pji and If we let x[k) = (xi[k] X2[k] . . . x n [k]) T and P = [pji] G 



R+ Xn , then ([T]) can be written in matrix form as 

x[k + 1] = Px[k]. (2) 

Note that, with the exception of the diagonal entries, we have pji = 0, j ^ i, if and only if 
(vj,Vi) S. We say that the nodes asymptotically reach average consensus if lim^oo Xj [k] = 
^'^^ for all Vj G V. The necessary and sufficient conditions for to reach average consensus 



are the following [19|: (a) P has a simple eigenvalue K(P) = 1 with left eigenvector 1 T and 
right eigenvector 1, and (b) all other eigenvalues of P (Xj(P),j ^ i) have magnitude less than 
1 (|Aj(P)| < 1). If P > (as in our case), the necessary and sufficient condition is that P be a 
primitive doubly stochastic matrix. 

To capture dynamically changing topologies we will assume that we are given a fixed set of 
components V = {vi, v 2 , . . . , v n } but the set of edges among them might change at various points 
in time. This results in a sequence of graphs of the form Q[k] = (V, £[&]). Given a collection 
of graphs £/[l], . . . , Q[m\ (for some m > 1) of the form Q[k] = (V, S[k\), k = 1, 2, . . . , m, the 
union graph is defined as Q\fl,...,m = (V, Uk£[k]). The collection of graphs is said to be jointly 
strongly connected, if its corresponding union graph Qi ; 2,..., m forms a strongly connected graph. 
A strongly connected graph certainly emerges if at least one of the graphs in the collection is 
strongly connected, but it could also emerge even if none of the graphs forming the union is 
strongly connected. 

B. Ratio Consensus 



In [26 1, an alternative algorithm is suggested that solves the average consensus problem in a 
directed graph in which each node Vj distributively sets the weights on its self-link and outgoing- 
links to be 1 + , so that the resulting weight matrix P is column stochastic, but not necessarily 
row stochastic. Average consensus is reached by using this weight matrix to run two iterations 
with appropriately chosen initial conditions. The algorithm is stated below for a specific choice 
of weights on each link that assumes that each node knows its out-degree; note, however, that the 
algorithm works for any set of weights that adhere to the graph structure and form a primitive 



column stochastic weight matrix. 



Lemma 1. [26] Consider a strongly connected graph Q(V,£). Let Vj[k] and Zj[k] (for all 



Vj G V and k = 0, 1, 2, . . .) be the result of the iterations 

Vj[ k + !] = PiiVA k \ + PjiVi\. k 1 ' (3) 
,[k + 1] = PjjZj[k] + PjM k ] , (4) 



where pu = - ]^ + for Vi G (zeros otherwise), and the initial conditions are y[0l = y and 
z[0] = 1. r/zen, ?/ze solution to the average consensus problem can be asymptotically obtained 
as 



where fij[k] = ^4r| 
Zj [k\ 



Note that the ratio consensus in [26] is actually a simpler version of more general algorithms 



that have appeared under various names in the literature (e.g., weak ergodicity property in OT 



or the push-sum algorithm in [ 30 1) 



C. Products of SIA Matrices 

Let A 1 , A 2 , . . . , A k be any square matrices of the same order. By a word (in the A's) of length 
£ G IN we mean the product of £ A's (repetitions permitted). A stochastic, indecomposable, and 
aperiodic (SIA) matrix is a column stochastic matrix B such that lim^oo B k exists and has all 
columns the same, i.e., it is a rank one matrix of the form cb1 t for some nonnegative column 
vector cb- For the derivation of our results we make use of the theorem by Wolfowitz [ |33| 
below. 



Theorem 1. [33] Let V = {P 1 ,P 2 , . . . , P m } be a collection of column stochastic matrices 



of the same order such that any word in the P 's is stochastic, indecomposable, and aperiodic 



(SIA). For any e > there exists an integer v(e) such that any word B = [bji] G R™ xri (in the 
P's) of length £ > v(e) satisfies 5(B) < e, where 5(B) = max.,- maxj l5 j 2 — bji 2 \. 

In words, Theorem [T] states that for large enough £, the product of £ matrices from the collection 
V has all of its columns approximately the same. Note that the result does not mean that all 
matrix products converge to a single matrix of the form cl T ; however, for large enough £, each 
word B will take the form cb1 t for some column vector cb- 

III. Modeling Delays and Switching 

A. Modeling Delays 

We first focus on the average consensus problem in the presence of bounded delays when 
the communication links among components are fixed and captured by an arbitrary strongly 
connected directed graph. More specifically, the transmission on the link from node Vi to node 
Vj at time step k undergoes an a priori unknown delay Tji[k], where Tji[k] is an integer that 
satisfies < Tji[k] < fji < oo (i.e., delays are bounded). The maximum delay is denoted by 
f = max^ fjj. We also assume that Tjj[k) = 0, VV,- G V, at all time instances k (i.e., the 
own value of a node is always available without delay). Note that this assumption is not critical 
and is made mostly for convenience. 

Under this model, the information available to node Vj at time step k (and which can be used 
to update its value to Xj[k + 1]) comprises of its own value Xj[k] and all values received by its 
neighbors by that time, i.e., it is a subset of the values in the set {x^f 5 ] | < s < k, Vi G A/y~} 
(recall that, in the directed graph setting we consider node, t>j selects the weight of the link 
(vj,Vi) and thus sends to node Vj the value x^jfs] = pjiXi[s]). The protocol we will employ 
relies on having each node Vj update its information state at time step k to Xjffc + l] by combining 
(in a linear fashion) its own value Xj[k] and the possibly delayed information received at that 
time step by its in-neighbors. In terms of the notation used above, this information is captured 
by {xj^jfs] | Vi G V , s + Tji[s) = k} . The exact way in which this information is used will be 
discussed later. 



B. Modeling Switching 

We consider a setting where the set of components in the multi-component system is fixed 
to V = {vi,v 2 , ■ ■ ■ ,v n }, but the (possibly directional) communication links between them are 
allowed to change. A convenient way of capturing this is to assume that we have a sequence of 
time- varying graphs of the form Q[k] = (V, £[&])). This means that at each time instant k, each 
node Vj has possibly different sets of in- and out-neighbors, denoted respectively by J\f~ [k] and 

Af;[k\. 

As in the case when there is no change in the interconnection topology, each node vj is in 
charge of setting the weights Pij[k], v\ £ J\fJ~{k], on all links to its out-neighbors. Due to the 
changing topology, the weight matrix will be time- varying and will be denoted by P[k). What 
is important is for P[k] to be column stochastic and have nonzero diagonal elements. As in 
Lemma [T| nodes can easily set the weights on the links to their out-neighbors to ensure column 
stochasticity as long as each node Vj has knowledge of its out-degree Afj~ [k] at each time step 
(in such case, each node Vj £ V sets pu = \ for vi £ Mf[k] U {]})■ There are various ways 

\-\- Is j \k,\ j 

in which the out-degree information can become available at each node (in undirected graphs 
this information is obviously available but even in directed graphs it can become available with 
simple protocols that we describe in more detail later). As we argue, even if the out-degree 
information becomes available with some delay, the protocols we propose can still be modified 
to reach consensus to the exact average of the nodes' initial values. 

In our analysis of changing interconnection topology, we consider two cases, 
(i) Switching without delays: When we have a varying interconnection topology and there exist 
no delays in the communication links, each node Vj updates its information state at time step 
k to Xj[k + 1] by combining its own state Xj[k] and the available information received by its 
neighbors {str^fA;] I v i e -^~[^]} ( me latter information also includes the positive weights Pji[k) 
that capture the weight of the information inflow assigned by component Vi to the link (vj, Vj) at 
time k). Here, we will consider two subcases: (a) each transmitting node knows its out-degree 
as soon as the change takes place, and (b) each transmitting node knows its out-degree with 
some delay. 



(ii) Switching with delays: In this case, each node Vj updates its information state at time step 
k to Xj ffc + l] by combining its own value Xj[k] and the available (possibly delayed) information 
I v i ^ -^j r [ s ]> s + T ji[ s ) = k} ( tne latter information also includes the positive weights 
Pji[s], that component Vi assigns to link (vj,Vi) at time s. We consider again the two cases (a) 
and (b) (where each node Vj discovers its out-degree without or with delay), and also consider 
a third case (c) in which a node Vj discovers an established link with some delay. 

IV. Handling Delays in a Directed Graph 

We first start with a static graph, where each link transmission can undergo a bounded delay. We 
assume that each node Vj chooses its self weight pjj and the weights {pij \ vi E A/?} on links to 
its out-neighbors so that these weights are positive and satisfy ^2 VlE j^+u{j}Pij = 1 f° r au " v j e ^ 
(a simple choice would be to set all of these weights to 1+ 1 D + as in Lemma |TJ. We employ a 
protocol where each node updates its information state according to the following relation: 



Xj 



[k + 1] = PjjXj[k] + 2j ^2 x J^ k ~~ r ]Ik-r,ji[r] , k = 0, 1, 2, . . . (5) 



where Xj^\k — r) = pjiX{[k — r), Xj[0] E R is the initial state of node Vj, and 

{1, if Tji [k] = r, 
(6) 
0, otherwise. 

In the absence of delays, we have Tji[k) = and the update relation (|5]) reduces to ([T]) with 
constant weights. We will show that if (|5]) is employed in place of ([T]) and is used to run two 
iterations as in Lemma [TJ the resulting ratio consensus approach can still be used to calculate 
the exact average, despite arbitrary but bounded delays at the communication links. Essentially, 
we establish that ([5]) is a ratio consensus protocol tolerant to arbitrary but bounded delays. 

Assumptions 1. For the analysis below we are given a graph Q(V,£) (that represents the 
information exchange between agents in a multi-agent system). Each node Vj E V has an initial 
value ?/o (j) and runs ratio consensus, i.e., two versions of the iteration in ([5]), one with initial 



value yo(j) and one with initial value z (j) = 1. We make the following assumptions: 
(Al) The graph is strongly connected, and the (nonnegative) weights pij are positive for I = j 
and (vi,Vj) G £, and satisfy Yui=iPij = 1 f or a ^ v j & V (so that they form a column 
stochastic matrix P). For simplicity, we will assume that each node sets the weights on 
the links to its outneighbors to = for I G Af^ U {j} (zero otherwise). 
(A2) There exists a finite f that uniformly bounds the delay terms; i.e. Tji[k] < t < oo for all 
links (vj,Vi) G £ for all time instants k. In addition, Tjj[k] = for all Vj G V and all k. 

Note that Assumption (Al) is necessary for the successful operation of any distributed algo- 
rithm seeking consensus. The particular choice of weights ensures that the weight matrix P is 
primitive column stochastic. Assumption (A2) implies that no message is lost in the network, 
the total delay in any communication link is uniformly bounded, and every agent updates its 
value using values from its in-neighbors at least once every f consecutive updates. The proof 
of the theorem below is developed in the remainder of this section. 

Theorem 2. Consider a strongly connected graph Q(V,£). Let Uj[k] and Zj[k] (for all vj G V 
and k = 0, 1, 2, . . .) be the result of the iterations 

f 

yj[k + 1] = PjjvAk] + J2 y ^ k ~ r ^-rA r ] > ( 7 ) 

f 

Zj [k + 1] = PjjZj[k] + Yl z ^ k " r ] /fc -^M ' ( g ) 

under Assumptions (Al) and (A2). The initial conditions are y[0] = and z[0] = 1, and Ikji 
is an indicator function that captures the bounded delay Tji[k] on link (vj,Vi) at iteration k 
(as defined in ([6]), Tji[k] < f). Then, the solution to the average consensus problem can be 
asymptotically obtained as hm /ij[k\ = ——. , vv\ G V , where p.j[K\ = ni . 

k^oo |V| z j[k\ 

Notice that the two iterations in the above theorem are coupled via the delays (the indicator 
functions Ik ji are the same in both iterations). Our proof is based on an augmented representation 
(graph) that allows us to model the distributed system with bounded delays as described in ([5]). We 



then use this augmented representation to establish that (for fixed communication topologies) the 
distributed ratio consensus algorithm in ([5]) will lead to asymptotic average consensus, regardless 
of the nature and order of the delays, as long as they are bounded. In the augmented graph 
representation, we add extra, "virtual" nodes and use them to model the delays. The maximum 
number of "virtual" nodes for each original node is bounded by the maximum delay f . In 
particular, for each node Vj G V we introduce f "virtual" nodes {v < f\v < f \ ■ ■ ■ i v ^p)- At each 
time step k, virtual node Vj holds the sum of the values that are destined to arrive to node vj 
in r steps. The augmented graph has (f + 1)|V| nodes and (1 + 2f)|£| edges. Before presenting 
the general case, we illustrate the augmented graph representation via an example. 

Example 1. Consider the network of two agents exchanging information as shown in Figure [7] 
Note that that the weights pu, p± 2 , p 2 i, and p 2 2 are all strictly positive, and satisfy pu +P21 = 1 
and P22+P12 = 1/ in the simple case presented in the introduction (and mentioned in Theorem^ 
we have p\ 2 = P22 = 1/(1 + ^t) = 1/2 and P21 = P11 = 1/ + = 1/2- Suppose the agents 
experience delays that are bounded by 2 (f = 2). Therefore, two extra "virtual" nodes will be 
added for each node ( see Figure |2p, depicting the states at which the delayed messages reside 
before reaching their destination ( refer to Figure [2]). 




Fig. 1. A simple example with two nodes when the links do not experience any delays. 



Taking x[k] = (x\[k] x 2 \k\ x± [k] x 2 [k] Xi[k] x 2 [k]) T , the iteration in the augmented 
graph can be written as x[k + 1] = P[A;]x[A;], where P[k] depends on the nature of delays. For 
example, when there are no delays in the network, say at time instant k = k\, the network is 



represented by Figure 2 'a) and the weight matrix is given by P[k\] below. Similarly, if at time 
instant k = k2 there is a delay of 2 at link (v2,v\) and a delay of 1 at link (vi,v 2 ) (the network 
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(a) Graph representation of the network at a time instant 
k — k\ when there exist no delays. As a result, each node 
uses the value sent by its neighbor directly, plus the delayed 
information (sent in previous time instances) that arrives at 
time instant k = ki. 
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(b) Graph representation of the network at a time instant 
k = k2 for which node v% sends information to node vi 
with delay Ti2(fc2) = 1, while node «i sends information 
to node V2 with delay T2i(fe) = 2. 



Fig. 2. A simple example with two nodes to illustrate the modeling of delays using the proposed augmented graph. The 
maximum allowable delay (f ) is 2. In Figure [(a)] there exist no delays between communication links at that time instant (k = ki), 
whereas in Figure [(b)! both nodes experience delays. Active links are shown by boldface black lines in each case. 



is shown in Figure 2 b)\, the matrix representation is given by P\k^ below. 
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P[k2] = 
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In the general case, in a network of n = |V| nodes, we introduce rn nodes (for a total of 
(r + l)n nodes) so that x[k + 1] = P[/c]x[/c], where 

/ rjm t n ... n \ 



P[k) 



Po[k] 

Pf-i[k] 
\ Pf[k] 

T 






^nxn 

o 



(9) 



l,2,...f. 



with x[k) = (x T [k] x V>[k] ... x^[k]) T and x^[k] = (x ( { ] [k) ... x^lk]), r 
Note that P [k] , P\ [k] , . . . , P? [k] are appropriately defined nonnegative matrices that depend on 



the link delays experienced by messages sent at time k and satisfy 

f 

P = J2 P Ak] , fc = 0,1,2,... 

Matrix P[k] may take at most (f + 1)^1 matrix values, where (f + 1) is the total number of 
states ("virtual" and original) for each node Vj. Specifically, if there exists an edge (vj,Vi) in 
the original graph, then that edge also exists in the augmented graph along with edges (vj,Vi), 
(vf\vi), . . ., (vy,Vi), and also edges (vj,vy), (vf\vy), . . ., (u| -1 \uj r) ). However, among 
the (f + 1) entries of P[k] corresponding to the edge (vj,Vi) only one of them could be nonzero 
(and equal to p^); the others will be zero. In the sequel we do not require the matrix P[k) to 
be known at each time step k; what we utilize is that P[k) will be a matrix from a finite set of 
possible matrices V, which have certain useful properties. 

Proposition 1. Let V = {Pi, P 2 , . . . , P( f+ iye\ } be the set of all possible P[k] as defined in @. 
Then, any finite length word B given by B = P[k)P[k + 1] . . . P[k + £] for some nonnegative 
integer £ is SIA. 

Proof: In order to prove that B is SIA, we have to show that it is (i) column stochastic, 
(ii) indecomposable, and (iii) aperiodic. 

(i) Column Stochasticity: This is easy to see as it is equivalent to proving that the product of 
two column stochastic matrices of the same order is also a column stochastic matrix (the result 
follows easily by induction), (ii) Indecomposability: Since all links receive nonnegative weights 
and the diagonals are strictly positive, indecomposability depends on the structure of the union 
graph that results from the collection of graphs corresponding to the matrices involved in the 
word B (the reason is that the positive diagonal elements ensure that if a matrix in the product 
has a positive entry at its (J, i) location, the product matrix B will also have a positive entry at 
its (j, i) location). Since any link (vj, Vj) in the original graph is maintained as a path from node 
Vi to node Vj (it is possible that this path has length greater than unity due to delay), the original 
nodes in the union graph form a strongly connected component. The remaining (virtual) nodes 
could be part of this strongly connected component (e.g., if only matrices that correspond to 



delays are introduced in the product B) but cannot form another strongly connected component 
because all of their paths have to eventually end to an original (non-virtual) node. The existence 
of a single strongly connected component in the union graph implies that the matrix product B 
is indecomposable, (iii) Aperiodicity: Aperiodicity of the graph is easily established due to the 
fact that the diagonal entries that correspond to original (non- virtual) nodes are nonzero. ■ 
We can now proceed with the proof of Theorem |2j 

Proof of Theorem H\ If we use the augmented graph representation with initial conditions 
y[0] = [ y T . . . 0] T and z[0] = [l T ... 0] T , we can write 

y[l] = P le ...P l2 P h y[0], 

v ' 

B 

z[l]=P ie ...P i2 P h z[0] . 

" v ' 

B 

By Proposition [T] and Theorem [T| we know that for any e > 0, the resulting word B satisfies 
(for i > v(e)) B — > c B( t T , where c Be is an appropriate vector, and the notation B — > C (for 
two matrices B = [bp] and C = [cji] of the same dimension) means that \bji — Cji\ < e for 
j, i E {1, 2, . . . , n}. Hence, for each iteration at time k > £ we have 

y[k] =P ih ...P i2 P h m ^c Bk l T y[0l 
z[k] = P lk . . . FfaiVfO] ->• c Bk t T z[0]. 

As a result, the ratio of the values of the two iterations at an original (non-virtual) node Vj E V 
is given by 

NU m c Bk (j)(lTz[0}) E, !£V ^[o] iv| ' 

as long as c Bk (j) ^ 0. This follows immediately from the fact that the matrix product P ik . . . Pi 2 Pi ± 
is SIA and the directed graph of the original (non-virtual) nodes is strongly connected and, 
therefore, all the entries in vector c Bk that correspond to the original (non- virtual) nodes are 
nonzero. Note that Hj[k], Vj E V, is identical to fij[k] defined in Theorem 15] and is always 



a finite quantity for all k > (because at each original (non-virtual) node Vj G V, we have 
Zj[k] > 0, VA; > 0; this is not necessarily true at the virtual nodes). ■ 

Example 2. Consider the directed network on the left of Figure [5] where each node Vj chooses 
its self-weight and the weights of its outgoing links to be (1 + 1 so that the weight matrix 
P is column stochastic as shown on the right of the figure. Each node Vj updates its information 
state Xj [k] using equation ([3]), so that the information state for the whole network is given by 
x[k + 1] = Px[k]. We first use the update formula Q with y[0] = (—1 2 3 4 2) T = y and 
no delays (f = 0). Since the update matrix is column stochastic, iteration ([3]) for this network 
converges, but not necessarily to the average (as shown in Figure 4(a)\ . As suggested in /|26]/, 
by simultaneously running two iterations y[k] and z[k] (using the weights in matrix P) with 
initial conditions y[0] = yo and z[0] = t, respectively, then average consensus is asymptotically 



reached for the ratio Vj[k]/ Zj[k] (see Figure 4(b)). 
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Fig. 3. A simple example of five nodes when the links do not experience any delays. 



We now consider delays by taking the maximum allowable delay to be f = 5. At each link at 
each time instant, the delay is an integer in {0, 1, 2, 5} (each chosen with probability 1/6). 
If we run our update formula (as in ^ ) for the same network (Figure^ with weights P and 



x[0] = yo, the algorithm does not converge (see Figure 5(a)). However, if we run ratio consensus 
in (|7]) and ([8]) with initial conditions y[0] = y and z[0] = 1 respectively, then average consensus 



is asymptotically reached for the ratio Uj[k]/zj[k] (Figure 5(b)). This demonstrates the validity 



Values at each node vs Number of iterations 



Ratio at each node vs Number of iterations 




Number of iterations 



(a) The iteration of <[TJ for the network in Figure [5] does 
not lead to average consensus (not even consensus) for the 
directed graph, since P is not a doubly stochastic matrix. 




Number of iterations 



(b) By running ratio consensus in {7} and (JSJ with appropriate 
initial conditions, average consensus is reached (no delays are 
introduced yet, i.e., f = 0). 



Fig. 4. Iteration j3j converges but does not reach consensus (left). By simultaneously running two iterations y[k] and z[k] (using 
the weights in matrix P) with initial conditions y[0] = yo and z[0] = 1, respectively, then average consensus is asymptotically 
reached for the ratio yj [k]/zj [k] (right). 



of our theoretical analysis, both in the sense that each of the individual iterations does not 
convergence and also in the sense that the ratios converge to the average of the initial values. 
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(a) The update rule {5} does not converge for the directed (b) By running ratio consensus in {7| and 1J8J with appropriate 
graph, due to the presence of delays. initial conditions, we can reach average consensus even in the 

presence of delays. 

Fig. 5. The update formula in l|5} for the network on the left of Figure [5] with weights P and x[0] = yo, does not converge 
(left); however, if we run ratio consensus in (7]l and (8} with initial conditions y[0] — yo and z[0] — 1 respectively, then average 
consensus is asymptotically reached for the ratio yj [k]/zj [k] (right). 



It is obvious from the simulations that the convergence speed of the algorithm depends on the 
delays (e.g., longer delays should result in slower convergence of the algorithm). Our discussion 
did not characterize the worst-case combination of delays but, nevertheless, the final average 



value is not affected by the particular realization of delays. 



Remark 1. In [14], [34], the following update formula is suggested 



xj[k + 1] = PjjXj[k] + 2j P'ji x i[k - dji[k)) , k = 0, 1, 2, . . . (10) 

where x[0] = yo, the weights p'^ form a doubly stochastic weight matrix P' = [p'-J and dji[k] 
is chosen so that node Vj uses in its update the most recently seen value from node V{ {i.e., 
dji[k] = mm Tji [k-t]=t,o<t<f{t})- Since the weight matrix P' = [p^] G R" xn is doubly stochastic, 
we know that in the absence of delays the iteration in ( fTO] ) would reach asymptotic average 
consensus. The iteration also reaches consensus in the presence of delays ( regardless of the 



delays introduced, as long as they are bounded ^34y), but not necessarily to the exact average 
of the initial values. The value the nodes converge to depends on the specific delays that are 
introduced during the execution of the iteration. 

V. Handling Changing Interconnections 

In this section, we extend the previous setting to include time-varying communication links 
(in addition to bounded delays on each link). We assume that we have a time-varying graph, in 
which the set of nodes is fixed but the communication links can change, i.e., at time step k the 
interconnections between components in the multi-component system are captured by a directed 
graph Q[k] = (V, E[k\). For the analysis below, we let Q = Q 2 , . . . , Q v }, v e IN, v< 2 n2 " n , 
be the set of all possible directed graphs^ defined for a given set of nodes V. We start our 
analysis by considering the simplest case where we have changing interconnection topology 
without delays and instantaneous knowledge at each node of its out-degree (at that particular 
time instant). We start with the assumptions below (some of these assumptions are relaxed later 
on). 

'Each of the n nodes may be connected (out-going link) with up to (n — 1) other nodes. As a result, we have n(n — 1) 
possible links, each of which can be either present or not. Hence, we have 2"' n_1 ^ possible graph combinations. Of course, 
depending on the underlying application, some of these interconnection topologies may be unrealizable. 



Assumptions 2. (Bl) At each time instant k, each node Vj knows the number of nodes receiving 

its message (i.e., the number of its out-neighbors T>j[k]). 
(B2) There exists no delays in the delivery of messages. 

(B3) Given the sequence of graphs ■ ■ ■, G[k\, . . ., we can find an infinite sequence 

of times t , t\, . . . , t m , where t = 0, < t m+ i — t m < £ < oo, with the property that 
for any m G Z + the union of graphs C?[£ m ], Q[t m + 1], . . . ,G[t m +i ~ 1] w jointly strongly 
connected. 

Remark 2. Assumption (Bl) requires that the transmitting node knows the number of nodes it 
transmits messages to at each time instant. In an undirected graph setting, this is not too difficult; 
in a directed graph setting, this is not as straightforward but there are many ways in which 
knowledge of the out-degree might be possible. For example, there can be an acknowledgement 
signal (ACK) via a distress signal (special tone in a control slot or some separate control 
channel) sent at higher power than normal so that it is received by transmitters in its vicinity 
/ p5] /. Knowledge of the out-degree is also possible if the nodes periodically perform checks 
to determine the number of their out-neighbors (e.g., by periodically transmitting the distress 
signals mentioned above). As we discuss later, at the cost of additional complexity, the nodes 
can also handle situations where they learn their out-degree with some delay. Assumption (B2) 
is made to keep things simple and its relaxed later. Assumption (B3) stems from the fact that we 
require that there exists paths between any pair of nodes infinitely often. 

In its general form, each node updates its information state according to the following relation: 

Xj[k+ 1] —Pjj[k]xj[k] + Xj<-i[k) , k = 0, 1, . . . (11) 

where Xj^i[k] = is the information sent from node Vi to node Vj at time step k, 

and Xj[0] 6 R is the initial state of node Vj. Since the out-degree is known at the transmitting 
node Vj it can easily set the (positive) weights pij[k] = - — ^+777 for / = j and (vi,Vj) 6 £[k) 
(this choice satisfies Y^i=iPijW\ = 1 f° r a ^ v j e Note that unspecified weights in P[k] 



are set to zero and correspond to pairs of nodes (vi,Vj) that are not connected at time step k, 
i.e., pij[k] = 0, for all (vi,Vj) S, j ^ i. If we let x[k] = (x\[k] x 2 [k] ... x n [k]) T and 
P[k] = [pji[k]} G R™ xrt then ([T|) can be written in matrix form as x[k + 1] = P[/c]x[A;], where 
ar[0] = (^[0] x 2 [0] ... x n [0]) T = x%. 

Note that, with the specific choice of matrix P[k) (based on the out-degree of each node as 
described above), the matrices P[k] are column stochastic and have strictly positive elements on 
their diagonals. This means means that products of such matrices (e.g., B = P[k + l]P[k + / — 
1] . . . P[k]) are also column stochastic and have strictly positive elements on their diagonals. In 
addition, a product B of such matrices will have a strictly positive value at its location, 
as long as at least one of the matrices P[-} has a positive entry at this same location. This is 
easy to show using the fact that the diagonal entries of all matrices involved in the product are 
strictly positive. Among other implications, this observation also means that if the union graph 
G[k], Q[k + 1], . . ., Q\k + I] is strongly connected, then the graph that corresponds to matrix 
B (based on its zero-nonzero structure) will also be strongly connected, and thus B is a SIA 
matrix. This fact will be important in our proof later on because it allows us to use the theorem 
by Wolfowitz (Theorem [T]) on a particular set of matrices. 

Remark 3. Communication links can be initiated throughout the operation of the algorithm 
or even terminated, from either (a) the receiving node or (b) the transmitting node. Possible 
communication protocols to perform these tasks are described briefly below, 
(a) When node V\ wants to receive messages from node Vj (e.g., because it is in the neighborhood 
ofvj), it can send a distress signal to pass this request to Vj (alternatively, node vi can send the 
message to node Vj using some path in the directed graph or using some sort of flooding scheme ). 
When node Vj receives the request from v\, it sends an acknowledgement packet (directly to node 
Vi) and the communication link is initiated. In practice, this might not necessarily require node 
Vj to transmit a separate package to node Vi (e.g., in a wireless broadcast setting) or to transmit 
at a higher power (e.g., if v\ is already in its range); however, it does imply that node Vj will 
adjust its self-weight and the weights pij, vi G Af^, on the links to its out-neighbors in order to 



ensure that column stochasticity is preserved. If, on the other hand, node v\ wants to terminate 
the communication link, it sends ( or broadcasts if there exists a single communication channel 
and the message cannot be specifically directed to node Vj) a distress signal destined for node Vj 
(alternatively, it can use a flooding-like strategy via the paths in the directed graph); as soon as 
node V\ receives an acknowledgement from node Vj along with the latest message with values for 
the last update, then the link can be terminated. If node v\ does not receive the acknowledgement 
message from node Vj the link remains active. 

(b) Note that if the transmitting node Vj wants to terminate a communication link to node v\, it 
is enough to simply initiate such a request to node V\ {since a direct link is available). 

Lemma 2. Consider a sequence of graphs of the form Q[k] = (V,£[k])), k = 0, 1, 2, ... such that 
there exists an infinite sequence of time instants to, ti, . . . , t m , . . ., where t = 0, < t m+ i — t m < 
t < oo, m G Z+, with the property that for any m G Z + the union of graphs Q[t m ],Q[t m + 
1], . . . , Q\t m+ i — 1] is strongly connected. Let Uj[k), Vfj G V, be the result of iteration ( [TTj ) 
with pij[k] = \ for v\ G A/" + [/c] (zeros otherwise) and initial conditions y[0] = yo, and 
let Zj [k] , G V, be the result of iteration 
otherwise) and with initial condition z[0] = 1. Then, the solution to the average consensus 
problem in the presence of dynamically changing topologies can be obtained as Hindoo [k] = 

^f^, Vt,, e V , /*[*] = 

Proof: Let P tm+1 -t m — ^[Wi _ l}P[t m+1 -2]... P[t m \. Since the union of graphs from 
time instant t m until t m+ i — I, i.e., the set of graphs &[t m ], Q[t m + 1], . . . , G[t m +i — 1], is strongly 
connected and each matrix involved in the product has strictly positive elements on the diagonals, 
matrix P t , is SIA for m G Z+. Furthermore, products of matrices of the form P t , are 
SIA. Hence, according to Theorem[T] for any e > 0, there exist a finite integer vie) G IN, such that 
a finite word W given by the product of a collection of v stochastic matrices of the form Pt m+1 -t m 
has all of its columns approximately the same, i.e., P tk+u -t k+u - 1 ■ ■ ■ p t k+2 -t k+1 Pt k+1 -t k ~> c Wv t T . 
Then, the proof continues as in the proof of Theorem [2} ■ 



1 1 ) with pij [k] 



for vi G Nj[k] (zeros 



A. Changing interconnection topology with communication delays 

Assumptions 3. For the case for which there exist delays we make the following extra assump- 



tion: 



(CI) There exists a finite r that uniformly bounds the delay terms, i.e. Tji[k] < Tji < t; this is 
the same as in assumption (A2). 

In this case, each node updates its information state according to the following iteration: 



x 



■[k + l]=pjj[k]xj[k]+^2 ^2 Xj^i[k - r]I k - rdi [r] , fc = 0,1,2,... (12) 

r=0 vieMr[k-r] 



where Xj^[k — r] = py^k — r]xi[k — r] is the value sent from node i>, to node Vj at time step 
k — r that occurs delay r, Xj[0] G R is the initial value of node Vj, and the values Pji[k] > 
depend on the topology of the graph at time k. 

To handle delays in a network of n = \V\ nodes, we introduce fn nodes (for a total of (f +l)n 
nodes) so that we can write 



x[k + 1] = P[k]x[k] , 



(13) 



where (as before) 



P [k] Inxn 

Pl[k] I nxn 

Pf-i[k] 

^ P f [k] 



(14) 



with 



x[k] = (x T [k] X W[k] ... x^[k]f , 
Wk] = (x<[ ) [k] ... !«[*]), r = l,2,...f. 



X 



As before, Po[k], P\[k], . . . , Pf[k] are appropriately defined nonnegative matrices, such that 

f 

F[*]=5>r[*], 

r=0 

i.e., the sum P[k] of all the nonnegative matrices P r [k], r G {0, 1,2, ... , f }, gives the weights of 
the zero-delay interconnection topology at time instant k. The difference from the case when only 
delays are present in the network is that the interconnection topology is dynamically changing 
and the weights at each time instant might differ. The proposed protocol is able to asymptotically 
reach average consensus, as stated in Lemma [3] below. The proof is similar to the proof for delays 
with no changes in the interconnection topology and is omitted. 

Lemma 3. Consider a sequence of graphs of the form Q[k] = {V,£[k})), k — 0, 1, 2, ... such that 
there exists an infinite sequence of time instants t , ti, . . . , t m , . . ., where t = 0, < t m+ i — t m < 
t < oo, m G Z + , with the property that for any m G Z + the union of graphs Q[t m ],Q[t m + 
1], . . . , Q[t m +i — 1] is strongly connected. Let Vj[k] for all Vj G V be the result of iteration < fl~2| ) 
with pij[k] = -L . . for vi G M^[k] (zeros otherwise) and initial conditions y[0] = yo, and 
let Zj [k] , Wvj G V, be the result of iteration 
otherwise) and with initial condition z[0] = 1. The indicator function l&jj captures the bounded 
delay Tji[k] on link (vj, Vi) at iteration k (as defined in (|6]), Tji[k] < f). Then, the solution to the 
average consensus problem can be asymptotically obtained as lim u, \k\ = ^"^'^j^ - , Vf , G 
V , where ^[k] = |{|. 

We now discuss the case in which a node, say node Vj, receives an indication (e.g., an 
acknowledgement message) that one of its out-neighbors, say V\ G A/^ + [k — 1], no longer receives 
its transmissions. In other words, node v t £ Mj~[k] but node Vj finds out about it with some 
bounded delay that we denote by Tij[k]. Such bounded delays could arise from communication 
protocols in a variety of ways, e.g., when using periodic acknowledgement signals like the 
distress signals discussed in Remark [3} Another way for node Vj to discover that its out-degree 
has changed is by using acknowledgement signals that arrive at node Vj through paths in the 
network that connect the out-neighbors of node Vj to node Vj (note that a direct link between 



1 1 ) with pij [k] 



for vi G N?[k) (zeros 



an out-neighbor of node Vj and node vj may not necessarily exist in a directed graph). 

We use Tij[k] < T < oo to denote the time it takes for node Vj to realize that node v\ is no 
longer in the set J\f^[k]. The problem that node Vj has to address at time k + Tij[k] when it 
realizes that, at time steps k, k + 1, . . . , k + T t j[k— 1], it erroneously assumed an out-degree V^ e 
that (supposing no other changes) was greater than the true out-degree V~- ', is that the weighted 
message from node vj that was not eventually conveyed to the out-neighbor vi (because the link 
was terminated) needs to be accounted for. The most straightforward way to reconcile this is 
to add these values back to node Vj. This can be done easily as long as node Vj keeps track 
of the messages it has recently transmitted — within the last T steps — to its out-neighbors. 
Note, however, that node Vj has to track these messages for each of its perceived out-neighbors, 
because if more than one out-neighbors terminate their links with Vj (possibly at different time 
steps), then node Vj must know what needs to be added back to its own value for each such 
former out-neighbor. One way to think about this is that node Vj adds, for each of its perceived 
out-neighbors, T "virtual" nodes that loop back to itself. These virtual nodes essentially keep 
track of the values that have been sent to each out-neighbor in the last T steps. The following 
example discusses this issue is more detailed. 



Consider, for example, node Vj with two out-neighbors (Vj = 2) shown in Figure 6(a) 
Suppose that the maximum delay required for an acknowledgement signal from any out-neighbor 
of node Vj is 2 (i.e., T = 2). Then, the model for the part of the network consisting of node 



Vj and its out-neighbors v\ x ,vi 2 is as shown in Figure 6(a) Suppose now that out-neighbor vi 2 
terminates the link v\ 2 Vj and node vj receives an ACK with delay 2. This means that node 
Vj erroneously considered an out-degree of 2 (instead of 1) for the last 2 updates. In this model, 
the message is passed through the two extra "virtual" nodes (added in a self-loop), allowing us 



to loop the weighted message back to node Vj (see Figure 6(b)). Therefore, node Vj is able to 



recover the lost values (sent to node vi 2 that is no longer an out- neighbor). 

Example 3. Consider the simple network with 3 nodes in Figure [7] and the following scenario: 
at instant k\ the network of the three nodes has no delays or interconnection topology changes; 




(a) A node Vj and its two out-neighbors. The maximum (b) A model in which node Vj directs the weighted messages 

delay required for an acknowledgement signal from the out- of the links that no longer exist as delayed information to 

neighbors of node Vj is 2. itself. In this example, node Vi 2 terminated the link and the 

ACK arrived at node Vj with maximum delay 2. 



Fig. 6. The weighted messages from node Vj that were not conveyed to the out-neighbor t>; 2 (because the link was terminated) 
are added back to the value of node Vj. 



at time instant k 2 , link v s ^— v\ terminates, and an acknowledgement is sent to node V\ via 
node v 2 , from which there exists a link to node v\. In addition, any message from v 2 to v\ can 
be delayed by at most 1 iteration. For simplicity, we assume that the delays in all other links 




Fig. 7. A model in which link vz ^— vi terminates, and an acknowledgement is send to node vi via node «2, from which 
there exists a direct link to node vi. In addition, the message from V2 to vi is delayed by 1. 

are zero and the connection with link v 2 cannot be lost; hence, no additional loops need to be 
inserted. Taking x[k] = (xi[k] x 2 [k] x^[k] x^\k] xf\k] xf\k}) T , the matrix representations 



at time instances k x and k 2 are captured by 
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In the general case, in a network of n = V nodes, we introduce max(™, Tn) nodes (for a 



total of (max(rn, Tn) + n) nodes) and we proceed as in ( p~3| ). 



Remark 4. There are also cases in which the transmitting node Vj may not have knowledge of its 
out-degree at time instant k. Such situations can also be handled if, at each time instant k, node 
Vj ( i) knows the number of nodes with which it has established a communication link in the past 
and were not officially terminated, and ( ii) is able to multicast a table of values to each of these 
out-neighbors. One way to do this is to employ the communication protocol proposed in j\36\/ 
where, at each time instant, each node Vj broadcasts its own state (as updated via the iterations 



in equation (fTTj)), as well as the sum of all the values, called the total mass in 136], that have 
been broadcasted to each neighboring node v\ G so far. If for any reason, some messages 
are lost {dropped) or the communication link disappears for some time-period, the total mass 
will enable the receiving out-neighbor to retrieve the information of the lost messages, with some 
time-delay. Thus, even though the communication links may not be reliable and can even change, 



the problem boils down to dealing with delayed information (as in Section |7V|). Note, however, 
that each node Vj needs to keep track of its own current state, the total mass transmitted to each 
neighboring node vi G (the total mass can be different for each node v\ due to, for example, 
newly established communication links), and the total mass received from each neighboring node 
Vi G Mf that transmits information to node Vj. Since different information might need to be 
transmitted to each node vi at each time instant k, node Vj is required to broadcast a table of 
values with entries for each receiving node. 



Example 4. We illustrate how the algorithm operates via a small network of six nodes. Each 
node Vj chooses its self-weight and the weight of its outgoing links at each time instant k 
to be (1 + Uj'lk})^ 1 (such that the sum of all weights Pij[k], Vi G Afj~[k], assigned by each 
node Vj to links to its out-neighbors at time step k is equal to 1). First, suppose the nodes 
experience only changes in interconnection topology but no delays. When each node updates 
its information state Xj [k] using equation ( fTT| ), the information state for the whole network is 
given by x[k + 1] = P[A;]x[A;], where P[k] depends on the links present at time instant k. For 
example, at time instants k — k% and k = ki, whose interconnection topologies are captured by 



the graphs in Figures 8(a) and 8(b) matrices P[k\] and P[k 2 ], respectively, are given by 
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1/4 1/2 1/4 
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1/4 1/4 1/2 1/3 
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1/3 1/3 1/5 
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We use twice the update formula (II) with initial conditions y[0] = (— 1 1 2 3 4 3) T and 
z[0] = t T respectively. In our simulations, we generate at each iteration a new random graph 
with six nodes that includes a directed link (vj,Vi) from node Vi to node Vj (Vi, Vj G V, Vi ^ Vj) 
with some probability p independently between different links. Note that once the graph is chosen 
at iteration k, the update matrix P[k] will be column stochastic. A realization of the ratios at 



each node is shown in Figure 9(a)' in this case, the average is 2. When delays are present with 



maximum delay f = 5 we use the update formula ( [12] ) with the same initial conditions and we 
observe that the system again converges to the exact average (as shown in Figure 9(b)} , but with 
a slower convergence. 



Remark 5. In many settings, it might be more natural for the communication protocol to allow 
the receiver to set the weights of the incoming values, since it is easier for each receiving node 
to know from which (and how many) nodes it has received a message. Indeed, consensus in 
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(a) Ratios at each node for changing interconnection topol- (b) Ratios at each node for changing interconnection topol- 

ogy and no delays. ogy with delays. 

Fig. 9. We use twice the update formula j I I [ i with initial conditions y[0] = (—1 1 2 3 4 3) T and z[0] = 1 T respectively, 
and plot the ratio y 3 -[k]/z 3 [k] for each node t)j under changing interconnection topology but no delays (left). When delays are 
present with maximum delay f — 5 we use the update formula |T2j with the same initial conditions and observe that the ratios 
again converge to the average, but with a slower convergence (right). 



multi-agent systems in directed graphs in the presence of changing interconnection topology and 
time-varying delays has been studied in /[77|/, which provided sufficient conditions for the multi- 
agent system to reach consensus when using a protocol that resembles the one used here, but 



with column stochastic matrices, instead of row stochastic matrices and one iteration instead of 
ratio consensus. More importantly, even though / [i7| / reaches consensus, it does not necessarily 
reach consensus to the exact average of the initial values of the nodes. 

Summarizing, by simultaneously running two iterations y[k] and z[k] as in ( [T2] ), with initial 
condition y[0] = x and z[0] = 1 T , respectively, then average consensus is asymptotically 
reached for the ratio yj[k]/zj[k], even in the presence of changing interconnection topology and 
delays in the communication between nodes, provided the graph characterizing the network is 
jointly strongly connected over consecutive time intervals infinitely often. 

VI. CONCLUSIONS 

In this paper, we studied distributed strategies for a discrete-time networked system to reach 
asymptotic average consensus in the presence of time-delays and dynamically changing topolo- 
gies. By assuming that nodes in the multi-agent system have knowledge of their out-degree (i.e., 
the number of nodes to which they send information to) and by modeling the time-delays using 
an augmented graphical model, we have shown that our proposed discrete-time strategy reaches 
asymptotic average consensus in a distributed fashion, in the presence of dynamically changing 
interconnection topology for whatever the realization of delays, as long as they are bounded 
and the union graph of the graph topologies over consecutive time intervals forms a strongly 
connected graph infinitely often. 
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